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Abstract. In this paper, we consider sampling and reconstruction of 
signals in a reproducing kernel subspace of L p (R d ),l < p < oo, as- 
sociated with an idempotent integral operator whose kernel has certain 
off-diagonal decay and regularity. The space of p-integrable non-uniform 
splines and the shift-invariant spaces generated by finitely many local- 
ized functions are our model examples of such reproducing kernel sub- 
spaces of L p (M. d ). We show that a signal in such reproducing kernel 
subspaces can be reconstructed in a stable way from its samples taken 
on a relatively-separated set with sufficiently small gap. We also study 
the exponential convergence, consistency, and the asymptotic pointwise 
error estimate of the iterative approximation-projection algorithm and 
the iterative frame algorithm for reconstructing a signal in those repro- 
ducing kernel spaces from its samples with sufficiently small gap. 
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1. Introduction 

Sampling and reconstruction is a cornerstone of signal processing. The 
most common form of sampling is the uniform sampling of a bandlimited 
signal. In this case, perfect reconstruction of the signal from its uniform 
samples is possible when the samples are taken at a rate greater than twice 
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the bandwidth [31[ |4"4"] . Motivated by the intensive research activity taking 
place around wavelets, the paradigm for sampling and reconstructing band- 
limited signals has been extended over the past decade to signals in shift- 
invariant spaces [H [52]. Recently, the above paradigm has been further 
extended to representing signals with finite rate of innovation, which are 
neither band- limited nor living in a shift-invariant space [181 l34l [48l [50l [53] . 
Here a signal is said to have finite rate of innovation if it has finite number 
of degrees of freedom per unit of time, that is, if it has requires only a finite 
number of samples per unit of time to specify the signal [53J. 

In this paper, we consider sampling and reconstruction of signals in a 
reproducing kernel subspace of L p (M. d ), 1 < p < oo. Here and henceforth 
LP := L p (M. d ) is the space of all p-integrable functions on the d-dimensional 
Euclidean space M. d with the standard norm || • H^p^d), or || • || p for short. A 
reproducing kernel subspace of L p (M. d ) [TO] is a closed subspace V of L p (M. d ) 
such that the evaluation functionals on V are continuous, i.e., for any x £ M. d 
there exists a positive constant C x such that 

(1.1) \f(x)\<C x \\f\\ LP{Rd) for all /€ V. 

Let 1 < p < oo. We say that a bounded linear operator T on L p {W d ) is 
an idempotent operator if it satisfies 

(1.2) T 2 = T. 

Denote by V the range space of the idempotent operator T on L p (R d ), i.e., 

(1.3) V:={Tf\ f£L p (R d )}. 

We say that the range space V of the idempotent operator T on L p (R d ) is 
a reproducing kernel space V associated with the idempotent operator T on 
L p (R d ) if it is a reproducing kernel subspace of L p (R d ). 

A trivial example of idempotent linear operators is the identity operator. 
In this case, the range space is the whole space L p (M. d ) on which the evalu- 
ation functional is not continuous. As pointed out in [37J, the whole space 
L 2 (M. d ) is too big to have stable sampling and reconstruction of signals be- 
longing to this space. So it would be reasonable to have certain additional 
constraints on the idempotent operator T. In this paper, we further assume 
that the idempotent operator T is an integral operator 

(1.4) Tf(x)= [ K(x,y)f(y)dy, f £ L p (R d ), 

JR d 

whose measurable kernel K has certain off-diagonal decay and regularity, 
namely, 



(1.5) 
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and 

(1.6) lim || sup \uj 5 (K)(- + z,z)\\\ L1(Rd) = 

\32\ I47j . Here the modulus of continuity los(K) of a kernel function K on 
R d x R d is denned by 

(1.7) u 5 (K)(x,y)= sup \K(x + x',y + y')-K(x,y)\. 

x',y'£[-S,S] d 

In this paper, we assume that signals to be sampled and represented live 
in a reproducing kernel space associated with an idempotent integral op- 
erator whose kernel satisfies (|1.5p and (jl.6p . The reason for this setting is 
three-fold. First, the range space of an idempotent integral operator whose 
kernel satisfies (|1.5p and (jl.6p is a reproducing kernel subspace of L p (R d ), 
see Theorem IA.1I in the Appendix. Secondly, signals in the range space of 
an idempotent integral operator whose kernel satisfies (jl.5p and (jl.6p have 
finite rate of innovation, see Theorem IA.2I in the Appendix. Thirdly, the 
common model spaces in sampling theory such as the space of p-integrable 
non-uniform splines of order n satisfying n — 1 continuity conditions at each 
knot |4H [54"] and the finitely-generated shift-invariant space with its gener- 
ators having certain regularity and decay at infinity [H [52] , are the range 
space of some idempotent integral operators whose kernels satisfy (|1.5p and 
(|1.6p . see Examples IA.4I and IA.5I in the Appendix. 

A discrete subset F of R d is said to be relatively-separated if 

(1.8) B r (6) := sup J2 x -y+i-S/2,6/2]4x) < °o 

x<ER d 7er 

for some 8 > 0, while a positive number 5 is said to be a gap of a relatively- 
separated subset T of M. d if 

(!-9) A T (5) := inf ^ X J+ [-d/2,5/2]d(x) > 1 

[8]. Note that the set of all positive numbers 5 with ^4r(^) > 1 is either an 
interval or an empty set because ^4r(<5) is an increasing function of 5 > 0. 
Then for a relatively-separated subset V of M d having positive gap, we define 
the smallest positive number 5 with Ay(5) > 1 as its maximal gap. One may 
verify that a bi-infinite increasing sequence A = {\k}kez of real numbers is 
relatively-separated if inffc e z(Afe + i — Afe) > 0, and that it has maximal gap 
sup fceZ (A fc+ i - A fc ) if it is finite. 

In this paper, we assume that the sample Y := (/(7)) 7 er of a signal / is 
taken on a relatively-separated subset T of M d with positive gap. 

The samplability is one of most important topics in sampling theory, 
see for instance [23j [28l [52] for band- limited signals, [U [48] for signals in 
a shift-invariant space, jTTl Ell [221 [25j [27] for signals in a co-orbit space, 
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and |30[ [36] for signals in reproducing kernel Hilbert and Banach spaces. 
In this paper, we study the samplability of signals in a reproducing kernel 
subspace of L p (M. d ) associated with an idempotent operator. Particularly, 
in Section we show that any signal in a reproducing kernel subspace V of 
L p (EL d ) associated with an idempotent operator whose kernel satisfies (]1.5p 
and (|1.6j) can be reconstructed in a stable way from its samples taken on 
a relatively-separated set T with sufficiently small gap 5, i.e., there exist 
positive constants A and B such that 

(1.10) A\\f\\ Lv{Rd) < [|(/(7)) 76 r[l*(T) < B\\fhpm for all / G V 

(see Theorem 12.11 for the precise statement). Here and henceforth, given 
a discrete set T, i p := £ P (T), 1 < p < do, is the space of all p-summable 
sequences on T with the standard norm || • ||e>(r), or || • || p for short. 

In this paper, we then study the linear reconstruction of a signal from its 
samples taken on a relatively-separated set with sufficiently small gap. The 
iterative approximation-projection reconstruction algorithm is an efficient 
algorithm to reconstruct a signal from its samples, which was introduced 
in [23] for reconstructing band-limited signals, and was later generalized to 
signals in shift-invariant spaces in [2]; see also [23] and the references 
therein for various generalizations and applications. In Section [3] of this 
paper, we introduce the iterative approximation-projection reconstruction 
algorithm for reconstructing a signal in a reproducing kernel subspace of 
L p (M. d ) from its samples taken on a relatively-separated set with sufficiently 
small gap, and study its exponential convergence, consistency, and numerical 
implementation of the above iterative approximation-projection algorithm 
(see Theorem 13. 1[ Remark 13.11 and Remark 13.21 for details). 

Denote the standard action between functions / G L p (K. d ) and g G 
£P/(P-1)(R*) by 

(1.11) (f,g)= [ f(x)g(x)dx. 

Then the stability condition (jl.lOp can be interpreted as the p-frame prop- 
erty of {if (7, -)} 7 er on the space V. Here for a Banach subspace V of 
L p (R d ), we say that a family 3> = {VvKer of functions in L p ^ p - 1 \R d ) is a 
p-frame for V [6] if there exist positive constants A and B such that 

(1.12) A\\f\\ Lvm < ||«/, V 7 )) 7e r|U (r) < B\\f\\ LP(Rd) for all feV. 

Then a natural linear reconstruction algorithm is the frame reconstruction 
algorithm; see |12[ 155] for reconstructing band-limited signals, [U (9J [TBI [33] 
for reconstructing signals in shift-invariant spaces, and [38] for reconstruct- 
ing signals in some reproducing kernel Hilbert spaces. In Section [H we 
introduce the preconditioned frame algorithm for reconstructing signals in a 
reproducing kernel space associated with an idempotent integral operator 
from its samples taken a relatively-separated set V with sufficiently small 
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gap, and study its exponential convergence and consistency (see Theorem 
HTTl for details). 

Reconstructing a function from data corrupted by noise and estimating 
the reconstruction error are leading problems in sampling theory, however 
they have not been given as much attention; see [19\ \39\ [35] for reconstruct- 
ing bandlimited signals, [5j [19] for reconstructing signals in shift-invariant 
spaces, and |13[ [3"*H [35] for reconstructing signals with finite rate of inno- 
vations. It is observed in [30] that reconstruction from noisy data may 
introduce spatially-dependent noise in the reconstructed signal (hence spa- 
tial dependent artifacts) that are undesirable for sub-pixel signal processing. 
Thus it is desirable to have an accurate error estimate of the reconstructed 
signal at each point. In this paper, we show that the reconstruction via 
the approximation-projection reconstruction algorithm and the frame recon- 
struction algorithm is unbiased, and we also provide an asymptotic estimate 
of the variance of the error between the reconstruction from noisy sample 
of a signal / via these algorithms and the signal / in a reproducing kernel 
space, see Theorem 15.11 and Remark 15.21 

The range space V of an idempotent operator T on L p (K. d ) has various 
properties. For instance, it is complementable and the null space N(T) := 
{g G L p (M. d ) | Tg = 0} is its algebraic and topological complement. In 
the appendix, some properties of the range space of an idempotent integral 
operator on L p (M. d ) whose kernel satisfies (jl.5p and (|1.6p are established, 
such as the reproducing kernel property in Theorem IA.1I and the frame 
property in Theorem IA.21 



2. SAMPLABILITY OF SIGNALS IN A REPRODUCING KERNEL SPACE 

In this section, we consider the samplability of signals in a reproducing 
kernel subspace V of L p (M. d ) associated with an idempotent integral operator 
whose kernel satisfies (|1.5|) and (|1.6|) ; by showing that any signal in V can 
be reconstructed in a stable way from its samples taken on a relatively- 
separated set with sufficiently small gap. 

Theorem 2.1. Let 1 < p < oo, T be an idempotent integral operator whose 
kernel K satisfies (jl.5p and (|1.6p . V be the reproducing kernel subspace of 
L p (M. d ) associated with the operator T, and 5q > be so chosen that 

(2.1) r := || sup \uj So/2 {K)(- + z, z)\\\ Ll(Rd) < 1. 

Then any signal f inV can be reconstructed in a stable way from its samples 
/(7), 7 G T, taken on a relatively-separated subset V of ~R d with gap 5q. 
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Moreover, 



(2.2) (l-r )(5^ d A r (5 )) 1/p \\f 



< 



(/(7)) 76 r|L r) < (l + r ){S d B r (S )) 1/p \\f 



I LP 



for all / G V. 



Now we apply the above samplability result to signals in a shift-invariant 
space. Let 



(2.3) 



■= {/| ll/llw := SU P + < 00} 

1 ,_^xe[-i/2,i/2] d J 



fcez d 



be the Wiener amalgam space [U [20]. Let (j>i, . . . ,cp r G W be continuous 
functions on M d with the property that {4>i{- — k) : 1 < z < r, fc G Z d } is an 
orthonormal subset of L 2 (M. d ). Then the integral operator T defined by 

(2.4) Tf(x) = Mx-k)My-k))f(y)dy for all / G L 2 (R d ) 

is an idempotent operator whose kernel satisfies (II. 5p and (|1.6jl . This yields 
the samplability of signals in a finitely-generated shift-invariant space [2]. 

Corollary 2.2. Lei 0i, . . . , (j) r G W 6e continuous functions on M. d such that 
-k)\ 1 <i <r,k £Z d } is an orthonormal subset of L 2 (R d ). Define 
the finitely-generated shift-invariant space V%{(f)\, . . . , <p r ) by 

r r 

(2.5) m ^^{^E^w--^ I E E i^( fe )i 2 < °°}- 

T/ien any signal f in ■ ■ ■ , <p r ) can be reconstructed in a stable way 

from its samples /(7),7 G T, taken on a relatively-separated subset T of~R d 
with sufficiently small gap 5q- 

The following theorem is a slight generalization of Theorem 12.11 

Theorem 2.3. Let 1 < p < 00, T be an idempotent integral operator whose 
kernel K is continuous and satisfies 

(2.6) sup \\K(x,-)\\ L i (Rd) + sup \\K(-,y)\\ LHRd) < 00, 



V be the reproducing kernel subspace of L p (R d ) associated with the operator 
T, and 8q > be so chosen that 

1-1/p 



(2.7) r' :- 



sup 



sup \K(x + 1, •) — K (x, ■) 

\t\<S /2 



x I sup 



sup \K(- + t,y) - K(- 

\t\<5 /2 



L 1 



l/p 



< 1. 



Then any signal f inV can be reconstructed in a stable way from its samples 
/(7), 7 G T ; taken on a relatively-separated subset T ofM. d with gap 5q- 
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Remark 2.1. The conclusion in Theorem 12.31 is established in \25\ Section 
7.5] when the kernel K of the idempotent operator T satisfies 



(2.8) K(x,y)=K(y,x). 

For p = 2, an idempotent operator T with kernel K satisfying (j2.8f) is a 
projection operator onto a closed subspace of I? . Hence the idempotent 
operator T with its kernel satisfying (j2.8f) is uniquely determined by its 
range space V onto L 2 . The above conclusion on the idempotent operator 
does not hold without the assumption (|2.8p on its kernel. We leave the 
above option on the kernel of idempotent operators free for better estimate 
in the gap 5q in Theorem 12. 1\ and also for our further study on local exact 
reconstruction (c.f. [3l l4"6j [5T] for signals in shift-invariant spaces). For 
instance, let us consider samplability of signals in the linear spline space 

Vi := | y c(fc)ft(x - k)\ sup \c(k)\ < ooj, 

where h{x) := max(l — |x|,0) is the hat function. It is well known [3] that 
a signal / in the linear spline space V\ can be reconstructed in a stable way 
from its samples /(7fc), k G Z, with maximal gap 5q := sup fcgZ (7fc + i — 7^) < 
1. For any integer N > 1, define 

K^(x,y) = 3 f' 2 Hx-k)h(N(y-l))(y/9N* - 6N-3N+lf~\ 

and let T/v be the integral operator with kernel Kjsf. One may verify that 
Tn, N > 1, are idempotent operators with the same range space V\ and the 
kernel Kn satisfies (I2.8P only when iV = 1. Recalling that K^(x—1, y— 1) = 
Kn{x,v) and Kn(—x, —y) = Kpf(x,y), we have 

sup || sup I-Kat^e + 1, •) — Kn(x, -)| ^ 

xeM |t|<<5o/2 

= sup |j sup \K N (x + t, •) - K N (x, -)||| 

xe[0,l/2] |t|<<5 /2 

< diV V (3JV-1- _ 6iV )l-l 

~ V9iV 2 - 6N ^ V ; 



X 



< 



sup II sup y \h(x -k)-h(x + t- k)\h(N(- - k- s))\\ 

xe[0,l/2] |*|<5o/2 fcgZ 

9iY<5 



6iV_4 

This shows that the inequality (|2.7p holds for = ET^v and p = 00 when 
2 4_ 

3 9W 



(5q < I — q4r. On the other hand, we have 



sup || sup \K\(x + t, •) — Ki(x, -)| || - 

x6K \t\<S /2 

> \\K 1 (S /2,.)-K 1 (0,.)\\ 1 = {9 -f )So : 
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which implies that the inequality (12, 7p does not hold for K = K\ and p = oo 
when 5q > 4 ^ ~ 0.5504 and so the theorem does not apply. 



We conclude this section by providing proofs of Theorems 12. II and 12.31 To 
prove Theorem 12. 11 we need a technical lemma. 

Lemma 2.4. Let 1 < p < oo, 5q £ (0, oo), r £ (0, 1), and V be a discrete 
subset of R d with the property that 

(2.9) 1 < A r (5 ) < B r (5 ) < oo. 

Assume that f E L p (M. d ) satisfies 

( 2 -!0) lk<5o/2(/)Lf(Kd) <r\\f\\upfa.d), 

and U := {u 7 } 7g r is a bounded uniform partition of unity (BUPU) associ- 
ated with the covering {7 + [— <5o/2, <5o/2] rf } 7S r ofM. d , i.e., 



(2.11) 

Then 



' < u 7 (x) < 1 for all and 7 S T, 

■u 7 is supported in 7 + [— <5o/2, 5o/2] d for each 7 S T,and 

E 7G r = 1 for a11 x G Rd - 



(2.12) (l-r)||/|| LP(Rd) < \\{f{l)\\u4 l lr m ) ieT tv { v) < + 
Proof. By the definition of the modulus of continuity, 

(2.13) \f{x)\ - \u &o/2 {f)(x)\ < |/(7)| < |/(x)| + K /2 (/)(*)| 

for all x E 7 + [S /2, 5 /2] d and 7 £ T. This together with ([22]) and (I2TTU1) 
proves (jZjjP - 

For 1 < p < 00, it follows from OTTUD . OTTTD . and that 



X / |/(x)|^ 7 (x)dx 
' 7er ^R d 

< (E/ l/(7)l^ 7 (x)^) 1/P +(^ / K /2 (/)(z)|%(x)<fe) 



< (Ei^)i p Kiii) 1/P + 

7 er 



Vi 



and 



ei/whkhi) 1/p < (e/ h/wi +^ /2(f)(x)\ p u,(x)dxy /p 

7 er 7 er ^ Rd 

< (l + r)[|/[|p. 

Then (|2.12p for 1 < p < 00 is proved. □ 
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Remark 2.2. Two popular examples of bounded uniform partitions of unity 
(BUPU) associated with the covering {7 + [— Sq/2, 5o/2] d } 7£ r of M. d are given 
by 



(2.14) 

and 
(2.15) 



u 7 (x) 



Xy+[-S /2,S /2} d ( x ) 



Syer X 



7'er A 7 '+[-«5 /2,5 /2] d 



(s) 



u -r( x ) = XvAx), 7 e r, 



where is the Voronoi polygon whose interior consists of all points in M d 
being closer to 7 than any other point 7' 6 T. 

Given a continuously differentiable function / on the real line, its modulus 
of continuity ug(f)(x) is dominated by the integral of its derivative /' on 
x + [—6,6], i.e., 

w«(/)(a?) < J + t)\dt for all 

Then the following result (which is well known for band-limited signals 
follows easily from Lemma 12.41 

Corollary 2.5. Let 1 < p < 00, f be a time signal satisfying 

(2.16) II/'IIm) ^ b oII/IIlp(r) 



for some positive constant Bq, and T = {^k}k& be a relatively-separated 
subset of R with maximal gap 6q < 1/Bq. Then there exists a positive 
constant C (that depends on Bq,By{6q) and Ay{6q) only) such that 

(2.17) C- l \\f\\ LPm < ||(/(7)ll^lli( P {Rd) ) 76r L (r) < C||/|| LP ( K ). 
Now we prove Theorem 12.11 

Proof of Theorem \2.1\ For any / G V, 

(2.18) |K /2 (/) || p = \\u; So/2 (Tf)\\ p < 



u 5o/2 {K){;y)\f{y)\dy 



< 



SUP \u So/2 (K)(- + 3,2)11^ 



ro 



v 



For any discrete set V with 1 < Ay(o~o) < -Br(^o) < 00, we define {ii 7 } 7 er 
as in (gUp . Then 



(2.19) 



°o 



< I it, 



B r (5o) " " A r (<5 ) 

From (|2.ip . (|2.18|) and Lemma 12.41 we obtain the estimates in (|2.2p for 
p = 00. On the other hand, from pi]) . pl8]) . (]2l9]) and Lemma [231 we 



< 



°0 



for all 7 G r. 
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get the following estimate for 1 < p < oo: 

El/WI P ) 1/P ^ (^r(5 )) 1 / ? '(El/(7)ni%lli' 1 "" 
7er 7 er 

< (5 - d S r (5o)) 1/p (l + ro) 

and 

7er 7 er 

> (<5 -^r(5o)) 1/p (l-r ) lullp . 
This proves (|2.2h for 1 < p < oo. □ 

Proof of Theorem \2.'J[ Similar argument used in the proof of Theorem 12,11 
can be applied to prove Theorem 12.31 We leave the detailed proof for the 
interested readers. □ 



3. Iterative approximation-projection reconstruction 

algorithm 

In this section, we show that signals in a reproducing kernel subspace 
of L p (M. d ) associated with an idempotent integral operator can be recon- 
structed, via an iterative approximation-projection reconstruction algorithm, 
from its samples taken on a relatively-separated set with sufficiently small 
gap. 

Theorem 3.1. Let 1 < p < oo, T be an idempotent integral operator whose 
kernel K satisfies (jl.5p and (|1.6p . V be the reproducing kernel subspace of 
L^IR^) associated with the operator T , and 5q > be so chosen that (|2.ip 
holds. Set 

r : = || sup \u So/2 (K)(- + z,z)\\\ Ll(Rd) . 

Then for any relatively-separated subset T with gap 5q and cq = (co(7)) 7 er £ 
P'iT), the sequence {f n }^=o of signals in V defined by 

(3 1) J = ^ 7er Tu ^ x ^ 

\ fn{x) = fo{x) + fn-i(x) - ^, jeT fn-l(.l) Tuj(x) for n > 1, 

converges exponentially, precisely 

(3.2) ||/„ - /oolliP(Rd) < l|r||||/o||z / p( K d)? , o +1 /( 1 - r o) for some G V, 

where U := {ii 7 } 7g r is a BUPU in ([2. lip . The sample of the limit signal 
/oo and the given initial data Co are related by 

(3.3) ^( C0 (7)-/ oo ( 7 ))rtt y (a;) = 0. 
■yer 
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Furthermore the iterative algorithm (]3.ip is consistent, i.e., if the given 
initial data cq = (g(j))^r is obtained by sampling a signal g € V then 
the sequence {f n }^Lo in the iterative algorithm (|3.ip converges to g. 

Proof. Define a bounded operator Qr,u ° n L p by 

(3.4) Q r ,uf(x) := ^(T/)( 7 )n 7 (x)-(T/)(x) 

= / (y / n 1 (x)K( 1 ,y)-K(x,y))f(y)dy, felf. 

Then 

(3.5) Q r ,uT = Q r ,u 
by and 

(3.6) \\Qr,uf\\p < ro\\f\\ P for all f £ L p 

by the following estimate for the integral kernel of the operator Qr,u'- 

(3.7) \^2ury(x)K^y,y) - K(x,y) < sup \u 6o/2 (K)(x - y + z', z')\. 

Define the approximation-projection operator Pr,u by 

(3.8) Pt, v = TQ r>u + T. 
Then it follows from JTSJ, ([33]) and that 

(3.9) P r ,c/T = TPr.c/ = ifyr, 

(3.10) (T - P r ,c/) n = (-l) n TQp iC/ for all n > 1, 
and 

(3.11) \\(T - Pr,u) n \\ < \\T\\rS for all n > 1. 
By ([31]), ([33]) and (pT8]h 

(3.12) /n+l-/n = (T-Pr,u)(fn-fn-l) 



= {T-Pv,u) n {h-h) 

= (r-Pr,f/) n+1 /o, n>0. 

This together with (|3.1ip proves the exponential convergence of f n ,n > 0, 
and the estimate (|3.2p . 

The equation (j3.3|) follows easily by taking limit on both sides of (13, ip 
and applying (|2.2p . 

Define 

oo 

(3.13) R AP :=T + J2(T-Pr,uT- 

n=l 



12 M. ZUHAIR NASHED AND QIYU SUN 

Then it follows from ()3.9p and (13. 1 lj) that Rap is a bounded operator on LP 
and a pseudo-inverse of the operator Pt,u, i-e., 

(3.14) R A pPr,u = Pf,uRap = T, 
and moreover it satisfies 

RapT = TRap = Rap- 
Applying (I3.12D iteratively leads to 

n 

(3.15) fn=(T + £(T - Pp,u) k )fo for all n > 1, 

fe=l 

which together with (|3.13j) implies that 

(3.16) /oo = lim /„ = i?Ap/o- 

n^oo 

In the case that the initial data Co is the sample of a signal g £ V, the initial 
signal /o in the iterative algorithm (|3.ip and the signal 5 are related by 

(3.17) f = P r ,ug. 

Combining (|3.14p . (|3.16p and A3. lTf> proves the consistency of the iterative 
algorithm (|3.ip . □ 



From the proof of Theorem 13.11 we have the following result for the op- 
erator Rap in (|3.13p . 

Corollary 3.2. Let 1 < p < oo, T be an idempotent integral operator whose 
kernel K satisfies (jl.5p and (jl.6p . V be the reproducing kernel subspace of 
L p (R d ) associated with the operator T, 5o > be so chosen that (|2.ip holds, 
r be a relatively-separated subset with gap 5q, U := {n 7 } 7e r is a BUPU in 
(|2.1ip . and Rap be as in (|3.13p . Then Rap is a bounded integral operator 
on L p (W i ) and its kernel Kap satisfies f) 1 . 5 1) . (|1.6p . anrf 
(3.18) 

ifAp(s>y)= / / K(x, z\)Kap(zi, Z2)K(z2, y)dz\dz2 for all x, y G M d . 

Remark 3.1. If the initial sample Co in the iterative approximation-projection 
reconstruction algorithm (|3.ip is the corrupted sample of a signal g E V, 
i.e., 

co = (5(7) +e(7)) 7 er 

for some noise e = (e(7)) 76 r ; then the LP norm of the original signal g and 
the recovered signal /oo via the iterative approximation-projection recon- 
struction algorithm (|3.ip is bounded by the (P norm of the noise e. More 
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precisely, from (|3.1ip and (|3.12p we obtain 

(3.19) ||/n-<?l|p 

oo n 

< E \\ T Qr,u(fo-h )\\ p + J2\\ T Qr,uh \\ P 

k=n+l k=0 

oo n 

< \\T\\ £ ^ll/o-Ziollp+llTllE^ll^ollp 

fc=n+l fc=0 

< [iriKi-^rHll/ol^ + llfcoy 

< llrfCl-ror^supKHO^dlcollpr^ + llell,,) 

7er 

and 

(3.20) ||/oo-5ll P < WTWil-ro^WhoWp 

< \\T\\ 2 (1 - r )~ 1 (sup ||M 7 ||i) 1/P ||e||p, 

where ho = J2jer e (l)'^ v "y anc ^ fn,n > 0, are given in the approximation- 
projection reconstruction algorithm (13. ip . Define the sample-to- noise ratio 
in the logarithmic decibel scale, a term for the power ratio between a sample 
and the background noise, by 

(3.21) SNR(dB) = 20 log 10 . 

Il e llp 

The estimate in (|3.19p suggests that the stopping step no for the iterative 
approximation-projection reconstruction algorithm (|3.1|) is 

[ SNR(dB) 

(3.22) n = ) , : 

V ; L201nio(l/r ). 

where [x] denotes the integral part of a real number x. In this case, 

(3.23) \\fn -g\\ P < 2||T|| 2 (1 - r )- 1 (sup||n 7 || 1 ) 1/p ||e|| p , 

7er 

and the error between the resulting signal f m and the original signal g is 
about twice the error due to the noise in the initial sample data. 

Remark 3.2. Given the initial data cq = (co(7)) 7 er> define 

(3.24) F n = (/ n ( 7 )) 7e r, n > 0, 
and 

(3.25) A = ((r v )( 7 )) 77 , 6r , 

where f n , n > 0, is given in the iterative approximation-projection recon- 
struction algorithm (13. ip . This leads to the discrete version of the iterative 
approximation-projection reconstruction algorithm (I3.1|) : 

f o 9fi N f Fo = Ac , 

[ ' 1 F n = F + (I-A)F n . 1 , n>l. 
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Exponential convergence: Now let us consider the exponential con- 
vergence of the sequence F n ,n > 0, when (|1.5p . (11 .6f) and (12. lj) hold. By 
(|3.26p . we have 



(3.27) 

Define 

(3.28) 



F n -F n _ 1 = (I-A) n F = (I-A) n Ac , n > 1. 



5>(7)i 

7er 



for c = (c(7)) 7er , 



where 1 < p < oo. For c = (c(7)) 7e r with [|c[| P) {7 < oo, write (/ — A) n Ac = 
{d n (l))yer and define cr,c/(x) = Yl-f<^r c ("f) u y( x )- Similar to the equation 
(|3.1ip we have 

(3-29) dn(rf) = (-lriTQlucr^). 

This together with (|3.6p implies that 



(3.30) 



\\{I-ATAc\\ p ,u 



< 



< 



J> 7 (.) f iK^zMQ^cr^ldz 



(\K{-,z)\ + \^ Q/2 (K)(;z)\)\{Q^ uCT)U )(z)\dz 



< C r%\\c\\ PtU 



C = || sup \K{- +z,z)\\ [l + || sup u So/2 (K)(- + z,z)\\ v 



where 
(3.31) 



Hence the exponential convergence of the sequence F n in the || • \\ p ^u norm 
follows from (I3T27]) and (13301) . 

Numerical stability and stopping rule: Next let us consider the nu- 
merical stability of the iterative algorithm (|3.26p . Assume that the numerical 
error in n-th iterative step in the iterative algorithm (|3.26p is e n ,n > 0, i.e., 



(3.32) 



F = Ac + e 

F n = F + (I - A)F n _ 1 + e n , n> 1. 



Let F n = (/ n (7)) 7g r,n > 0, where f n ,n > 0, are given in the iterative 
approximation-projection reconstruction algorithm (|3.ip with initial data 
cq. By induction, we obtain 



n-l 



(3.33) 



F n -F n = - ~ A) n ~ l ~ k Ae k + i n , 



k=0 
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where eo = eo and = (k + l)eo + ^i + • • • + e& for k > 1. Therefore 
(3-34) ||F n — F n \\ P}U 

n-l 

< ^ - A)"- 1 -^^^ + ||e n || PiC/ 

fc=0 
n-l 

< ^ Co r o~ 1 ~ fc ||efc||p,t/ + ||gn||p,[/ 
fc=0 

rt— 1 fc 

< Co E r o^ fc ((^ + i)iiediip,i/ + E iMkt/ 

fc=o i=i 

n 

+(n + l)||e ||p,[/ + ^2 W e iWpV 
i=i 

- il + r °° + 1 )H e ollp,t/ + Yl IMIp.c 

Denote the limit of F n as n tends to infinity by F^. By (|3.27p and f|3.30[) 
we have 

(3.35) \\F n - Foo \\ PjU < jtc r k +1 \\co\\ PtU < ^rflHI^. 

k=n 

Define the sample-to- numerical-error ratio (SNER) of the iterative algorithm 
(I3.32j) in the logarithmic decibel scale by 

(3.36) SNER(dB) = 20 inf log 10 n IMI P ,l/ 



tr* olU II || i v— vn || || 

n > l n\\eo\\ Pt u + z^j=i \\ e j\\p,u 
Then 

(3.37) \\F n - F n \\ p<u < l - ro + Co (n + l)lO- SNER ( dB )/ 20 ||co|| P)[/ , 

l - r 

which together with (|3.35|) implies that 

(3.38) H^-FoelU < l^^( r ^ + (n + l)lO- SNER ( dB )/ 20 )|| C o|| PiC ;. 

This suggests that a reasonable stopping step n\ in the iterative algorithm 
(|3T26|) is 

- SNER(dB) _ log l0 (ln(l/r )) _ i 
-20log l0 (l/r ) log lo l/r J' 

as the function f(y) = Tq + yi o _SNER ( dB )/ 20 attains the absolute minimum 
at 

SNER(dB) log l0 (ln(l/r )) 



(3.39) m 



(3.40) y :-- 



20log l0 (l/r ) log l0 l/r 
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4. Iterative frame reconstruction algorithm 



In this section, we study the convergence and consistency of the iter- 
ative frame algorithm for reconstructing a signal in the reproducing ker- 
nel subspace of L p (R d ) associated with an idempotent integral operator 
from its samples taken a relatively-separated set with sufficient small gap. 
The readers may refer to |14l [15] for an introduction to frame theory, and 
[U [U [J_2j [TBI E3 EHl EE] for various frame algorithms to reconstruct a signal 
from its samples. 

Theorem 4.1. Let 1 < p < oo, T be an idempotent integral operator whose 
kernel K satisfies (jl.5p and (jl.6p . V be the reproducing kernel subspace of 
L p (M. d ) associated with the operator T , and 5\ > be so chosen that 



(4.1) 

where 

and 



r :-- 



r 2 := (2ri + r )r < 1, 
sup \uj Si/2 (K)(- + z,z)\\\ Ll 



sup \K{- + z, z) 

zeR d 



Let T be a relatively-separated subset o/M with gap 5\, U = {u 7 } 7g r be a 
BUPU associated with the covering {7+ [— 0i/2, 0i/2] rf } 7g r> and 

(4.2) Sr,uf(x) := X)( r /)(7)KII^(K")^7), / 6 L p (M d ) 

6e i/ie preconditioned frame operator on L p (M. d ). Given a sequence Co = 
(co(7)) 7 gr £ £ P (T), we define the iterative frame reconstruction algorithm 
by 



(4.3) 



fo = E 7 er c o (7) 1 1 -" 7 1 1 l 1 ^) 7 ^ ("'T). 

fn = fo + fn-1 - Sr,ufn-1, Tl > 1. 



Then the iterative algorithm 
sistent. Moreover, 

(4.4) 

where 



3D converges to /oo exponentially and is con- 
foo = -Rf/o; 



(4.5) 



n=l 



and is a pseudo-inverse of the 
RpT = TRf = R-p and RpSr,u = Sf^Rf = T. 



defines a bounded integral operator on LP 
preconditioned frame operator Sr u > i- e -> 

(4.6) 
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Furthermore, the kernel Kp(x,y) of the integral operator Rp satisfies (11.51 

(fL6|) . and 

(4.7) 

Kp(x,y) = I I K(x,zi)Kf(zi, Z2)K(z2,y)dz\dz2 for all x, y G M. d . 

JR d JR d 

Proof. Define an integral operator u by 

(4.8) C r ,uf(x) = f [ (V(if(x,7)-i^)KW 

JR d JR d v 7gr 

x(K( 1 ,y)-K(z,y)))f(y)dydz for all / G U\ 

and let ^ be the adjoint of the integral operator Qr,u in (|3.4j) . i.e., 
(4.9) 

Qr,uf(x)= f (y j {K{ 1 ,x)-K{y,x))u 1 {y))f(y)dy for all / G L p . 
Then 

(4.10) 5 r ,y — T = TQ r ,u + Q^T + C r ,c/, 
which implies that 

(4.11) ||^/-r/|| p 

< l|r||||Qr >£ //|| P + ||Qr,c/r/|| p + ||Cr >t //|| p 

< llTll" ' 



+ 



+ 



hs 1 /2(- -y)\f(y)\dy 

hs 1 /2{z ~ -)\Tf{z)\dz 

hs!/2(- - z)h 8l / 2 {z - y)\f(y)\dydz 



< rail/Hp for all / G V, 
where hs = sup^/ gR d u>$(K)(- + z', z'). 



By the iterative algorithm (|4.3p . 



(4.12) 



/n = /o + ]T(T - S T ,u) k f for all n > 1. 



k=l 



This together with (|4.1ip proves the exponential convergence of f n ,n > 0, 
and the limit function is given by 



By (|1.2p . (|4.2p and Theorem I A. II in the Appendix, we have 
(4.13) S r ,uT = TS r ,u = S r ,u- 

This together with the exponential convergence of the right hand side of the 
equation (|4.5p establishes that Rp is a bounded operator and satisfies (|4.6p . 
and hence it is the pseudo-inverse of Sr,u- 
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The consistency of the frame iterative algorithm (|4.3h follows from ()4.4j) 
and the fact that fo = Sr,u9 if the initial data Co = (<?(7)) 7e r is the sample 
of g E V taken on the set I\ 

From dUSD, (|Q]> . (Oil . (Oil and (jITTUI) . it follows that 

oo 

|| sup |^ F (- + z',z , )||| 1 < || sup |^(- + z , ,z / )l|| 1 + ^(^)"<oo. 

z'eM d 2'eM d n=1 

Hence Kp satisfies the off-diagonal decay property ()l,5p . The reproducing 
equality (|4.7p follows from 

TRpT = R F 

by (|4.6p . The regularity property (ll.6p for the kernel Jfp holds because of the 
off-diagonal decay property (jl.5h for the kernel i* 1 , the regularity property 
(I1.6P for the kernel -?T of the idempotent operator T, and the following 
estimate 

u s (K F )(x,y) < f f los(K)(x,z 1 )\K f (z 1 ,z 2 )\ 

JR d JR d 

x(\K(z 2 ,y)\ +u; s (K)(z 2 ,y))dz 1 dz 2 
+ / \K(x,zi)\\K F (zi,z 2 )\\uJs(K)(z 2 ,y)\dzidz 2 
by gZJ). □ 



5. Asymptotic pointwise error estimates for reconstruction 

algorithms 

In this section, we discuss the asymptotic pointwise error estimate for 
reconstructing a signal from its samples corrupted by white noises, as the 
maximal gap of the sampling set tends to zero. 

Theorem 5.1. Let 1 < p < oo, T be an idempotent integral operator whose 
kernel K satisfies (|1.5p and (|1.6|) . and V be the reproducing kernel subspace 
of L p (M. d ) associated with the operator T. Let V be a relatively-separated 
subset ofM. d with gap 5, U := {u 7 } 7e r & e a BUPU associated with the cov- 
ering {7 + [— 5/2, S/2] d } 1& r, and R := {R 1 (x)} je r be either the displayer 
{(\\ u 7\\L 1 (R d ))~ 1 R&P u ')}~i& in the approximation-projection reconstruction 
algorithm or the displayer {R F K(-, 7)} 7g r in the frame reconstruction al- 
gorithm where the operators Rap and Rp are defined in (I3.13|) and (|4.5p 
respectively. Assume that €(7), 7 £ T, are bounded i.i.d. noises with zero 
mean and a 2 variance, i.e., 

(5.1) e( 7 ) G [-B,B], E(e(i)) = 0, and Var(e( 7 )) = a 2 

for some positive constant B, and that the initial data cq is the sample of a 
signal g G V taken on V corrupted by random noise e := (e(7)) 7g r; i-c, 

(5-2) c = ( 5 (7) + e(7))76r. 
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Then for any x G M. d 

(5.3) E(g(x) - Rco{x)) = 
and 

(5.4) Var(o(x) - i?c (x)) = ^ ||u 7 ||2 1(IRd) |i? 7 (x) 

7er 



2 



< o" sup H^lliiflRd) I / \K(x, z)\ dz + o(l) ) as (5 — > 0, 

where 
(5.5) 

i?c (x) = } J c ('j)\\u 7 \\ L i( 1 i t d)Ily(x) for all c = (c (7)) 7S r G £°°(r). 
7 er 

Furthermore if 

(5.6) H^ll^imd) = a(5)(l + o(l)) as 5 — ► 



/or some positive numbers a(5) independent 0/7, i/ten t/ie inequality in ([5? 
becomes an equality, i.e., 

(5.7) Yai(g(x) - Rc (x)) = a(5)a 2 ( [ \K(x, z)\ 2 dz + o(l)) 
as 5 Lena's to zero. 

Remark 5.1. The error estimate (15. 7p is established in [5] for reconstruct- 
ing signals in a finitely-generated shift-invariant subspace of L 2 (M. d ) from 
corrupted uniform sampling data via the frame reconstruction algorithm. 
More precisely, T = 5Z d , u 7 (x) = X[-5/2,8/2] d ( x ~ 7) f° r 7 £ T, the idempo- 
tent operator T is defined in (|2.4p . and the range space associated with the 
idempotent operator T is the shift-invariant space Vz((f)i, ■ ■ ■ , 4> r ) m (|2.5p . 



Remark 5.2. By the definition of a BUPU associated with the covering 
{7 + [-5/2,5/2] d }^ r of R d , we have 

(5.8) IKIIzW) < S d . 



The above inequality becomes an equality when V = 5Z d and it 7 = X[-s/2,8/2] d - 
It is expensive to find the operators -Rap and Rf when the sampling set has 
very small gap 5. As noticed in the proof of Theorem 15-H both operators 
are close to the idempotent operator T when the sampling set has very 
small gap. Then a natural replacement of the displayer i? 7 in (|5.5p is either 
(||tt 7 || i i( K d))~ 1 Tti 7 or K(-,j). In both cases, the variance estimates in (|5.4p 
and (15.71) still hold, but the unbiased condition (15.41) does not. 



To prove Theorem 15. 11 we need several technical lemmas. The first lemma 
is a slight generalization of Theorem 15.11 
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Lemma 5.2. Let the operator T, the kernel K, the reproducing kernel space 
V, the sampling set T, the bounded uniform partition of unity U = {u 7 } 7 grj 
the random noise e, and the variance a of the noise e be as in Theorem \5.1\ 
and let the displayer R := {Ry(x)} 1& r satisfy 

(5.9) g(x) = ^ 5 r(7)||u 7 || i i (R[i)j R 7 (x) for all g e V, 

7er 

and 

(5.10) lim||sup sup \Ry(- + z) ~ K{- + z, z)\ II, 1(Rd) = 0. 

S->0 7 er ze7+ [-5/2,<5/2] d 1 ' 

Then Q, ([521) and §51} hold. 
Proof. Set 

(5.11) hg(x) = sup sup |i? 7 (x + z) — ET(x + z, z)|. 

76r z67+[-<5/2,<5/2] d 

By ([T3]) . flgUPP and (I5TTTD . we have 

(5.12) y)||« 7 ||i|A y (ic)| < / y2u 7 (z)(\K(x,z)\ +h 5 (x-z))dz 
7er J* d 7er 

< || sup |K(- + z,^)||| 1 + H^lli < oo. 

z£R d 

This together with (|5.ip and (|5.9p leads to 

(5.13) E(g(x) - Rc (x)) = s(^€( 7 )||« 7 ||iA r (x)) 

7er 

= ^S(e(7))KI|iA r (a:) = 0, 

and the unbiased property (|5.3|) for the reconstruction process in (|5.5|) fol- 
lows. 

By dSTTD, and (I5TT2]) . we obtain 

Var( 5 (x) - Rcq(x)) = £?( e( 7 )||n 7 || lJ R 7 (x)) 2 

7er 

= a^Kllfl^Cx)! 2 . 

7er 
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Therefore 



(5.14) Yar(g(x) - Rc {x)) 

< c 2 ( sup ||« 7 ||i) ( ||n 7 ||i|iiy(x) 



^ er 7 er 



< <T 2 ( sup ||u 7 ||i) ( / (\K(x, z)\ + \h$(x - z)\) 2 dz) 

^cr V /rod / 



7 er 

< CT 2 (sup ||%||i) ( / \K(x, z)\ 2 dz + o(l) 
7 Gr ^ jR d 

where we have used (|5.10p and (|5.1ip to obtain the last two estimates. Hence 
the variance estimate (j5.4|) for the reconstruction process in (|5.5p is estab- 
lished. 



By dES}, doTTUD and (jSTTSj) . we get 

(5.15) Var( 5 (x) - Rcq(x)) 

= a 2 (a(5) + o(l))(^||u 7 || 1 | J R 7 (x)| : 



7 er 

2 



(<*(<*) + o(l)) ( / (if (x, z) + 0(/i tf (x - z))) 2 cfe) 
a 2 a{5)( [ \K{x,z)\ 2 dz + o(l)\ 

V /rod / 



and hence (|5.7p is proved. □ 

Lemma 5.3. Let i/ie operator T, the kernel K, the reproducing kernel space 
V , the sampling set V, the bounded uniform partition of unity U = {u 7 } 7e r, 
the random noise e, and the variance a of the noise e be as in Theorem \5.1[ 
and let the displayer R = {i? 7 } 76 p be defined by 

(5.16) Rj = (WuyWi^RApUj,^ £ T 

where Rap is given in (|3.13p . Then the above displayer R satisfies (|5.9p and 
(15TT01) . 

Proof. By (|3.13p . (|3.16p and (|3.17p . the reconstruction formula (|5.9p holds 
for the displayer R in ()5.16p . 

Denote the kernel of the integral operators Rap — T by i^AP- By (|1.2p . 
(pL?D , (dHO]), (^T3]) and (l3~THl) . we have 



(5.17) K AP (x,y)= / if(x,zi)A'Ap(^i, ^2)^(^2, ^2, 
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and 
(5.18) 



sup |JKap(- + z 'i A 



< V|| sup |^(- + z / ,z , )||| 1 (|| sup |^ /2 (K)(- + z / ,z / )l|| 1 
-» as 5 ->■ 0. 



This together with (11. 5ft and (II. 6ft implies that 
(5.19) 



< 



sup sup KII^tIIi) 1 Rapu 1 (- + z) — K(- + z', z 

7er 2 ' 67 +[_,5/2,5/2] d 

sup u s {K)(- + z',z') + sup / / \K(- + z, Zl )\ 

x|Xap(^i, ^2)1(1^(22,^)1 + \ug(K)(z2, z)\)dzidzs 
as 5 -> 0. 



Hence (l5TT0jl follows. 



□ 



Lemma 5.4. Let i/te operator T , the kernel K , the reproducing kernel space 
V , the sampling set T, the bounded uniform partition of unity U = {w 7 } 7g r> 
the random noise e, and the variance a of the noise e be as in Theorem \5.1\ 
and let the displayer R = {i? 7 } 76 r be defined by 



R y = R F K(;'y), 7 er 



(5.20) 



where Rp is given in (14.5p . Then the above displayer R satisfies (]5.9f) and 
flSHQD - 

Proof. The reconstruction formula (|5.9p follows from Theorem 14.11 

Denote the integral kernel of the integral operator Rp — T by Kp. Then 



(5.21) 

and 
(5.22) 



K F (x,y) 



K(x, zi)K F (zi, z 2 )K(z 2 ,y)dz 1 dz 2 , 



|| sup \Kp(- + z,z)\\\ l 

00 

< Y.{ 2 \\ sup \ K (- + z ^)\\\i + II su p NWO + ^.^llli 

x (|| sup \uj$(K)(- + 2, z)| ||^ — >• as 5 — > 



ra=l 
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by (HSJ, g3D, and ffiXI . Therefore 

/ sup sup l-Rpii" (-,7))(x + 2;) — + 2, z)\dx 
jR d 7er 2e ,v + [_,5/2 A/2l d 
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< 



76r ^e7+[-<5/2,5/2] 

sup sup |i^(x + z, 7) — isT(x + z, z)\dx 
' 7er zG 7 +[-«5/2,5/2] d 



+ / sup sup 

: 7Gr ze7+[-5/2,<5/2] d 



< 



+ 



K{x + 2,^1)^(21,22)^(^2,7)^1^2 dx 
sup 1 0^/2 (if) (2; + z, z')\dx 

sup |if(x - 21 + z , z')\) ( sup \Kp(zi - z 2 + z', z')\) 

; 'eiR d z'eR d 

x( sup \K(z 2 + z' ,z')\ + sup 0^/2 (-K") (22 + z\z')\)dz\didx 

□ 



-> as 5 -> 0. 
Then (|5.10p is established for the displayer i? in (|5.20p . 



Proof of Theorem \5.1\ The conclusions in Theorem 15.11 follows directly from 
Lemmas and El □ 



Appendix A. Reproducing kernel subspaces of L p (R d ) associated 

WITH IDEMPOTENT INTEGRAL OPERATORS 

The range space associated with an idempotent operator T on L P (R. ) 
whose kernel satisfies (j 1 . 5 1) and (jl.6p include the space of all p-integrable 
non-uniform splines of order n satisfying n — 1 continuity conditions at each 
knot (Example IA.4|) , and the space introduced in |48j for modeling signals 
with finite rate of innovation (Example IA.5|) . In this appendix, we establish 
some properties of such range spaces, particularly the reproducing kernel 
property in Theorem lA.il and the frame property in Theorem IA. 21 

A.l. Reproducing kernel property. In this subsection, we show that 
the range space of an idempotent operator on L p (R. d ) whose kernel satisfies 
(jl.5p and (|1.6p has some properties similar to the ones for a reproducing 
kernel Hilbert subspace of L 2 (R a! ). 

Theorem A.l. Let T be an idempotent integral operator on L p (M. d ) whose 
kernel K satisfies (jl.5p and (jl.6p . and V be the range space of the operator 
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T. Set 

a s (q) = 5- d+d /«(\\sup\K(. + z,z)\\\ Ll{Rd) ) 1/q 



1-1/9 



x (II sup \K(- + z,z)\\\ L1(Rd) + || sup \u s (K)(- + z,z 

v z£R d zeR d 

and 

b 5 {q) = (6 rf + 1)1-1/^-^11 sup \ US ( K) (. + Z , z) \\\ 

for 5 > and 1 < q < oo. T/ien 

(i) V is a reproducing kernel subspace of L p (R d ). Moreover, 

\f(x)\ < a 5 (p/(p-l))\\f\\ LP{Rd) 

for any f G V and 5 > 0. 

(ii) The kernel K satisfies the "reproducing kernel property": 

(A.l) / K(x,z)K{z,y)dz = K(x,y) for all x, y G R d . 

(iii) K(-,y) G V for any y G R d . 

(iv) The functions K(x, •), K(-,y), us(K)(x,-) and tos(K)(-,y) belong to 
L q (R d ) for all x, y G R d and 1 < q < oo, and their L q (R d )-norms 
are uniformly bounded. Moreover, 

(A.2) maxl sup \\K{x,-)\\ Lq( pd), sup \\K{-,y)\\ Lq{Rd) \ < a s (q) 

v xeR d y&R d 

and 

(A.3) maxf sup \\u s (K)(x,-)\\ Lq( ^d), sup \\uJs(K)(-,y)\\ Lq ( Rd) ) < b s (q). 

v x£R d y&R d ' 

Proof (iv): Note that 

(A.4) \K(x,y)\ < \K(x,z)\ + \u s (K)(x,z)\ 

holds for all y,z G kd + [-5/2, 5/2} d and x G R d , where jfe G Z d and <5 > 0, 
we then have 

>,y)\<6- d 

lkS+[-S/2,S/2] d 



(A.5) \K{x,y)\ < 5- d [ (\K(x,z)\ + \u s (K)(x, z)\)dz. 

J kS+\-S /2,S/2] d 



Thus 



sup || -K" (a;, 

x£R d 



and 



< 5~ d sup sup / (\K(x,z)\ + \u s (K)(x,z)\)dz 

x&R d keZ d Jk6+{-6/2,6/2] d 

< 5- d (\\ sup |K(. + z,z)||| i + || sup |a; 5 (^)(- + z,z)||| 1 ) 

v z£R d z£R d ' 

sup \\K(x,-)\\ x < || sup |K(- + z,^||| r 
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Interpolating the above estimates for the L 1 and L°° norms of K(x, •), we 
obtain 

(A.6) suppr(av)|| g <aa(g). 
Similarly, we have 

(A.7) sup\\K(-,y)\\ q <a s (q). 

y eR d 

Therefore follows. 

From the definition of modulus of continuity, we obtain 

(A.8) sup u s {K)(x,y) 

yekS+[-8/2,S/2] d 

< inf ujs(K)(x, z) + W2s(K)(x, z) 

zek5+[-5/2,S/2] d 

< 5- d I (ios(K)(x,z)+u 2S (K)(x,z))dz 

Jk6+[-8/2,8/2] d 

for any x G M. d and k G Z rf , and 

(A.9) w 25 (K)(x,y)< J2 L0 5 (K)(x + e5,y + e'5) 

e,e'e{-l,0,l} d 

for all x, y G M d . By an argument similar to the one used in establishing 
(jA.6l) and (jA.7[) except we now use (1A.8|) instead of (!A.4j) and apply (|A.9jl 
to estimate || sup 2g]R d ll>25(K)(- + z,z)\\i, we then obtain 

(A.10) sup \\io 5 (K)(x,-)\\ q < (6 d + l) 1 - 1 //T d + d '*\\ sup lj 5 (K)(- + z,z)\\ v 

xeR d zeR d 

and 
(A.ll) 

sup \\us(K)(.,y)\\ q <(6 d + l) 1 - 1 ^S- d+d /"\\ sup \u s (K)(- + z, z)\\\ r 

yeR d z£K d 

Combining (jATTOj) and (jATTTj) proves (fOj) . 

(i) : By COD and (TO|) . we have 

|/(x)| < ||^,-)m p -l)ll/ll P <«5(p/(p-l))ll/ll P 

for all x G M d and / G V. Then (fATT]) holds and V is a reproducing kernel 
subspace of LP . 

(ii) : Noting that 

sup I K(x + z,y)K(y, z)dy dx < ( f ( sup \K (x + z, z)\}dx\ < oo, 



we then have that the kernel 

A( X >V) '■= / K(x + z,y)K(y,z)dy - K(x,y) 
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of the linear operator T 2 — T satisfies || sup^^d \A(- + z, z)||L < oo. This 
together with (jl.2p proves (jA.ip . 

(iii): The conclusion that K(-,y) G 1/ for any 1/ G l d follows from (lA.lj) 
and $X~2\i . □ 

A. 2. Frame property. In this subsection, we show that the range space 
of an idempotent integral operator whose kernel satisfies (|1.5|) and (|1.6p 
has localized frames. Let 1 < p < 00, V C L p and C L p ^ p ^ l \ We 
say that the p-frame = {0a}asA C W for V and the — l)-frame 
^ = {4>\}\eA C V for form a duaZ pair if the following reconstruction 
formulae hold: 

(A.12) f = J2(f,k)<f>\ for all / G V, 

AeA 

and 

(A.13) g = ^(g, </> a )^a for all g G W. 

AeA 

Here we denote by (/, g) the standard action (jl.lip between a function 
f £ L p and a function 5 G L p ^ p ~ l \ 

Theorem A. 2. Let 1 < p < 00, T be an idempotent integral operator on 
L p (R d ) whose kernel K satisfies (ll.5p and (II. 6|) . T* 6e i/ie adjoint of the 
idempotent operator T , i.e., 

(A.14) T*g{x)= I K(y,x)g(y)dy for all <? G L^ 1 ^), 



and fet y and be the range spaces of the operator T on L P (M ) and 
the operator T* on L p ^ p ~ 1 \M. d ) respectively. Then there exist a relatively- 
separated subset A, and two families := {4>x}\&A of functions 4>\ G V and 
$ := {(px}\eA of functions (f)\ G V* such that 

(i) Both $ and & are localized in the sense that 
(A.15) 

\<f>x(z)\ + \k(z)\^Kx-\) 

\us(<f)\)(x) + los(4 ) x)(x)\ < hs(x - A) for all A G A and x G R d . 
where h and h$ are integrable functions with 

(A.16) limJNIi =0, 

0— >o 

(ii) $ is a p-frame for V and & is a p/(p — l)-frame for V* . 

(iii) $ and <E> form a dual pair. 

(iv) Both V and V* are generated by $ and <3? respectively in the sense 
that 

(A.17) V = V p ($) := { J] c(A)^|(c(A))A e A G £ P (A)}, 

AeA 
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and 

(A.18) V* = V p /(p-i)(&) := {^c(A)^ A |(c(A)) A6A G M^A)}. 

AeA 

For an orthogonal projection operator T on L 2 (M. d ) whose kernel satisfies 
(jl.5p and (jl.6p . we have the following result for its range space, which is 
established in [27] under a weak assumption that the orthogonal projection 
property for the operator T is replaced by the existence of a bounded pseudo- 
inverse. 

Corollary A. 3. LetT be an orthogonal projection operator onL 2 (M. d ) whose 
integral kernel K satisfies (jl.5p and (jl.6p . and let V be the range space of 
the operator T on L 2 (M. d ). Then there exist a relatively- separated subset A 
and a family of functions ^ := {V^aIagA Jn V such that <3? is a localized tight 
frame in the sense that 

\Mx)\ <h(x-X) 

us(il>\){x) < hs(x - A) for all A G A and x G M d , 

where h G L 1 (R d ) and h$ are integrable functions with lim^o ||^j||i = 0; 
and 

(A.20) f = YAf, 1>\)4\ for all / G V. 



(A.19) 



AeA 



Moreover, 



(A.21) V = V 2 {$) := { 5>(A)Va| (c(A)) AeA G 



AeA 



Remark A.l. The space Vp(3>) was introduced in [48J to model signals with 
finite rate of innovations. From Theorem lA.2l we see that signals in a repro- 
ducing kernel subspace associated with an idempotent operator on L p ( 
with its kernel satisfying (jl.5p and (jl.6p have finite rate of innovation. 



We conclude this subsection with the proofs of Theorem [A2] and Corollary 

Proof of Theorem \A.1A Let <5o > be a sufficiently small positive number 
chosen later. Define the operator T$ by 

(A.22) T 5 J(x)= [ K So (x,y)f(y)dy f G L p (M. d ), 

where 
(A.23) 

K 5o (x,y) = 5 Q d / V K(x,X+z 1 )K(X+z 2 ,y)dz 1 dz 2 . 

J[-5 /2,5 /2]d J[-5 /2,5 /2]d 

Then 

(A.24) T 5o T = TT So = T 5o 
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by CL2]), and 

(A.25) \K 5o (x,y) - K(x,y)\ < [ \K{x,z)\\u 5o {K){z,y)\dz 
by Theorem IA.1I Therefore 

(A.26) ||T, /-T/[| p <ri(J )[|/[| P for all f £ L p , 

where 

n(6 ) = || sup \K(- +z,z)\\\ 1 \\ sup \uj 5q (K)(- +z,z)\\ r 



Let 5o > be so chosen that ri(5o) < 1. The existence of such a positive 
number follows from (|1.5p and (jl.6p . Then it follows from (|A.24|) . (|A.25P 
and (|A.26j) that the operator T$ defined by 

oo 

(A.27) Tl :=T + J2(T-T 6o r 

n=l 

is a bounded integral operator with the property that 
(A.28) TlT SQ = T So Tl = T, 

and that the kernel Kd$ of the operator Tg satisfies 

(A.29) || sup |lfD,i (- + z > *)||| 1 < oo 

z6K< i 

and 

(A.30) Jim || sup \uj s (K D) s )(- +z,z)\\\ 1 = 0. 

Define 



" '" r 5o/2]d K DtSo {x,zi)K(z 1 , A + z 2 )dz 2 dz 1 



(A.31) I ^ = <y rf Su"S[-6o/2 

for all A S 5o^ d ) and set 

$ = {Mag^ and * = {^Ae^- 

Now let us verify that the above two families $ and <E> of functions satisfy 
all required properties. By (|A.27|) . (|A.3ip and Theorem IA.ll 

(A.32) c/)x e V and (j>\ G V* for all A G <J Z d . 
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Moreover, 

< C P I I {sup\K(y-z + z',z')\) 

J[-S ,5o] d ^'eK d 
x( sup \K Dj s (x - A - y + z',z')\)dydz, 

N(0a)(*)| < *o d/P [ I ( \K(y-z + z',z')\) 

J[-S ,8 ] d J-R d z'eM d 

x( sup I^^d^o)^ - ^ - 2/ + ^,^)\)dydz, 
z'eK d 

|0a(*)| <5 ^ (p ~ 1)/p / ( sup \K(X-x + z + z',z')\)dz, 

J[-8 ,S ] d z'm d 

and 

< S d(p - 1)/P [ ( sup \uJs(K)(X-x + z + z',z')\)dz. 

J[-s ,s ] d z 'eM d 

The above estimates for (f>\, u>s((j)\), (f>\ and us(<j)\), together with (|1.5|) . (|1.6p . 
()A.29|) and ()A.30p . prove (|A.15|) and hence the localized frame property (i) 
for $ and <l. 

By (TQ8|) . we have 

(A.33) / = Tj o T 5o / = A )0 A / G V, 

aga 

and 

(A.34) 5 = Tfi (T% o )*g = ^(g, A )0 A for all 5 € V*. 

AeA 

Then the dual pair property (ii) for <3? and follows. 

The p-frame property for <E> and the p/(p— l)-frame property for $ follow 
from the localization property (i) and the dual pair property (ii) for $ and 

We leave the detailed proof for the interested readers. 

The inclusion V C V p ($) follows from the p-frame property for <t> and 
the reconstruction formula / = X^AeA(/> <^a)0a for any / G V. The reverse 
inclusion V p (<&) C V follows from (|A.32p and the closedness of the space V 
in L p . This proves that V = V p ($). The conclusion V* = V p /r p _i)($) can 
be established by similar arguments. □ 

Proof of Corollary \A.3l By the argument in the proof of Theorem I A. 2\ there 
exists a positive number 5q and a family $ = {4>\\\ & s 'L d °f functions in 
V such that $ is a localized frame for V . Then the autocorrelation ma- 
trix := ({<p\, 0a'))a \ / eS i d belongs to the Gohberg-Baskakov-Sjostrand 
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class C(6oIi d ) by the localization property (1A.15|1 . Here the Gohberg-Baskakov- 
Sjostrand class C(5oL d ) is given by 

(A.35) C(5 Z d ) = {A:=(a(\,\')) WSoZd 

\\A\\ C := sup |a(A + A', A')| < oo) 

[HI ESI H21 H31 US] . By the frame property for <£, the square root of the auto- 

1 /2 + 

correlation matrix A$ t $ has bounded pseudo-inverse (A^ . This together 
with the Wiener's lemma for infinite matrices in the Gohberg-Baskakov- 
Sjostrand class pH EH HH 031 09] shows that 

(4^)t := (6(A,A')) a ,aW e C(5 Z d ). 

Then one may easily verify that ^ = {^a}a§m i! is a localized tight frame 
for V that has all the required properties (|A.19p - (|A.2ip . where 

\>es z d 

□ 

A. 3. Examples. In this subsection, we present two examples of a repro- 
ducing kernel space associated with an idempotent integral operator on LP. 

Example A. 4. [51] Let n > 1, A = {Xk}k& be a bi-infinite increasing 
sequence of real numbers with 

< inf (A fe+ i - A fc ) < sup(A fc+ i - A fc ) < oo, 

and 

(A.36) S%-\A) = {/er'(K): /| [AfciAfe+l] is a polynomial 

having degree at most n for each k G z). 

Let Bi be the normalized B-spline associated with the knots A«, . . . , Aj+ n +i, 
and define its autocorrelation matrix A = [(Bi, Bj)^. ^. Then the infinite 

matrix A is invertible and its inverse B = {bij)i^^% has exponential off- 
diagonal decay, that is, there exist constants C and e such that 

\bij\ < Cexp(-e|i - j\) 

Define 

K(x,y) = H^hjBjiy) 

and 

Tf(x)= [ K(x,y)f(y)dy. 

Then one may verify that the above integral operator T is an idempotent 
operator on the kernel K of the operator T satisfies (II. 5j) and (|1.6j) . 
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and S£ -1 (A) n L P (R) is the range of the operator T on L P (R). The spline 
model has many practical advantages over the band-limited model in Shan- 
non's sampling theory, and has been well-studied (see (50J [52J, [54] and the 
references therein). 

Example A. 5. [48] Let A be a relatively-separated subset of M. d with pos- 
itive gap, <3? = {(^aIasA an d 5> = {4>\}\<=a be two families of functions such 
that 

\Mx)\ + \4>x{x)\<h(x-X), xeR d , 

and 

\u s (<t>\)(x)\ + M<£a)0)I < h s (x - A), x G M d , 
hold for all A G A and 5 > 0, where /i and are functions in the Wiener 
amalgam space W with lim^o ll^allw = 0- Then one may verify that the 
kernel function 

(A.37) K(x,y):=Y,Mx)My) 

AeA 

satisfies (jl.5p and (|1.6j) . If we further assume that $ and <I> satisfy 

4>\( x )4>\'( x )dx = 6x,\' for all A, A' G A, 

where Sxx' stands for the Kronecker symbol, then the operator T with the 
kernel K in (jA.37j) is an idempotent operator on L 2 . In this case, 

(A.38) y 2 (d>) := { £ c(X)Mx) I £ |c(A)| 2 < 00} 

AeA AeA 

is the range space of the operator T on I? and hence a reproducing kernel 
subspace of 1? . A special case of the above space V^($) is the finitely- 
generated shift-invariant space V2(</>i, • • • , 4> T ) in (|2.5p . see [H [U [33] and 
references therein. 

Acknowledgement: The authors would like to thank Professors Akram 
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